Quantum Pattern Retrieval by Qubit Networks with Hebb Interactions 
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Qubit networks with long-range interactions inspired by the Hebb rule can be used as quantum 
associative memories. Starting from a uniform superposition, the unitary evolution generated by 
these interactions drives the network through a quantum phase transition at a critical computation 
time, after which ferromagnetic order guarantees that a measurement retrieves the stored pattern. 
The maximum memory capacity of these qubit networks is reached at a memory density a — p/n — 1. 
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Historically, the interest in neural networks 111 has 
been driven by the desire to build machines capable of 
performing higher cognitive tasks, for which the sequen- 
tial circuit paradigm of Babbage and von Neumann is not 
well suited, like pattern recognition and categorization. 

On the other side, the last decade has seen the emer- 
gence of quantum mechanics as a powerful new paradigm 
for computation 2\ . The focus of these developments has 
been mostly on the quantum circuit model, in which a 
set of elementary universal quantum gates are sequen- 
tially applied on qubit registers, the root of the interest 
lying mainly in the speed-up with respect to classical 
computation. 

In this paper we shall propose a different quantum in- 
formation processing system, which is capable of higher 
cognitive tasks as described above. Instead of one- and 
two-qubit interactions that are switched on and off se- 
quentially, we will consider fixed, long-range interactions 
inspired by neural networks, focusing for concreteness on 
one particular model, the associative memory model of 
Hopfield 0. The result is a fully-connected interacting 
network of qubits in which memories are encoded in the 
long-range interaction matrix: the corresponding Hamil- 
tonian generates a unitary evolution capable of memory 
retrieval and pattern recognition. Note that some of the 
most promising technologies for the implementation of 
quantum information processing, like optical lattices Q 
and arrays of quantum dots |a| rely exactly on similar 
collective phenomena. 

In mathematical terms, the simplest neural network 
model is a directed graph with the following properties: 

1. A state variable rii is associated with each node 
(neuron) i. 

2. A real- valued weight Wij is associated with each 
link (synapse) (ij) between two nodes i and j. 
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3. A state-space- valued transfer function f{hi) of the 



synaptic potential hi — J^j 
dynamics of the network. 



determines the 



Two types of dynamical evolution have been considered: 
sequential or parallel synchronous. In the first case the 
neurons are updated one at a time according to 
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while in the second case all neurons are updated at the 
same time. The simplest model is obtained when neurons 
become binary variables taking only the values rii — ±1 
for all i and the transfer function becomes the sign func- 
tion. This is the original McCuUogh-Pitts ^ neural net- 
work model, in which the two states represent quiescent 
and firing neurons. 

The Hopfield model ^ is a fully-connected McCuUogh- 
Pitts network in which the synaptic weights are symmet 
ric quantities chosen according to the Hebb rule 
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Here n is the total number of neurons and are p binary 
patterns to be memorized (^f = il) 

For p/n < 0.138 the network works as an associative 
memory, permitting recall of information only on the ba- 
sis of its content, without any information on storage 
location: the stored patterns are attractors for the dy- 
namics ^ defined by the transfer function. For higher 
loading factors p/n, however a phase transition to a spin 
glass phase impairs the ability to correctly recall mem- 
ories. 

The "quantization" of Hopfield networks can be car- 
ried out straightforwardly by substituting each neuron 
with a qubit i.e. a quantum degree of freedom with a 
two-dimensional Hilbert space whose basis states can be 
labeled as |0 > and |1 >. The only tricky point regards 
the treatment of interactions bewteen the qubits. In the 
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classical model the dynamics (QJ induced by the transfer 
function is fully deterministic and irreversible, which is 
not compatible with quantum mechanics. A first general- 
ization that has been considered is that of stochastic neu- 
rons, in which the transfer function determines only the 
probabilities that the classical state variables will take 
one of the two values: ni{t -I- 1) = ±1 with probabili- 
ties f{±hi{t)), where / must satisfy f{h — oo) = 0, 
f{h +oo) = 1 and f{h) + f{~h) = 1. 

While this modification makes the dynamics proba- 
bilistic by introducing thermal noise, the evolution of the 
network is still irreversible since the actual values of the 
neurons are prescribed after an update step. In quantum 
mechanics the evolution must be reversible and only the 
magnitudes of the changes in the neuron variables can 
be postulated. Actually, the dynamics must generate a 
unitary evolution of the network. 

To this end we propose the following "transverse" 
Hamiltonian: 

H^jJ2w.,a!<j], (3) 

where u'^, k = x,y, z denote the Pauli matrices and J is 
a coupling constant with the dimensions of mass (we use 
units c — l,h— 1). This generates a unitary evolution 
of the network: 

exp(^m) 1^0 > , (4) 

where 1-00 >= IV'l^ = 0) >. Specifically, we will choose 
as initial configuration of the network the uniform super- 
position of all computational basis states 0] 

V ^ x=0 

This corresponds to a " blank memory" in the sense that 
all possible states have the same probability of being re- 
covered upon measurement. In the language of spin sys- 
tems this is a state in which all spins are aligned in the 
X direction. 

Inputs can be accomodated by adding an external 
transverse magnetic field along the y axis, i.e. modifying 
the Hamiltonian to 

n = jJ2 + 9 E hr<^l , (6) 

ij i 

where hf^'^ = 'Ylij'^ij^f^'^ ■ This external magnetic field 
can be thought of as arising from the interaction of the 
network with an additional " sensory" qubit register pre- 
pared in the state , the synaptic weights between the 
two layers being identical to those of the network self- 
couplings. 

Let us now specialize to the simplest case of one as- 
signed memory ^ in which Wij = ^i^j- In the classical 
Hopfield model there are two nominal stable states that 
represent attractors for the dynamics, the pattern ^ it- 
self and its negative — ^. Correspondingly, the quantum 



dynamics defined by the Hamiltonian Q and the initial 
state (O have a Z2 symmetry generated by erf , cor- 
responding to the inversion |0 >^ |1 > of all qubits. 

Since the qubits of the network are fully connected 
and weakly interacting, the model can be expected to 
be exactly solvable in the n 00 limit by a mean- 
field theory. Indeed, this is known to become exact for 
weak, long-range interactions In the mean- field ap- 
proximation operators are decomposed in a sum of their 
mean values and fluctuations around it, =< af > 
+ (erf — < erf >), and quadratic terms in the fluctuations 
are neglected in the Hamiltonian. Apart from an irrele- 
vant constant, this gives 

Hn.i = J E (< > +jhr) +a!<hy>, 

■i 

<h^ > - E w,j < >= e» m'' , (7) 

j 

where m'^ = (V") < '^i > the average over- 
lap of the state of the network with the stored pattern. 
This means that each qubit i interacts with the aver- 
age magnetic field (synaptic potential) < hf > due to 
all other qubits: naturally, the correct values of these 
mean magnetic fields < /if > have to be determined self- 
consistently. 

To this end we compute the average pattern overlaps 
m'^ using the mean field Hamiltonian {T)) to generate the 
time evolution of the quantum state. This reduces to a 
sequence of factorized rotations in the Hilbert spaces of 
each qubit, giving 

— —- — r sin 2Jt\m\ , 
\m,\ 

= ^fl-J- sin 2Jt\m\ , (8) 



where \m\ = ^J{myf + {m^ + {g/J)M'=f and M"" = 

(1/n) the average overlap of the external 

stimulus with the stored memory. 

Before we present the detailed solution of these equa- 
tions, let us illustrate the mechanism underlying the 
quantum associative memory. To this end we note that, 
for g = 0, the pattern overlaps and in the two 
directions cannot be simultaneously different from zero. 
As we show below, only ^ for J > (for J < 
the roles of and are interchanged). In this case 
the evolution of the network becomes a sequence of n 
rotations 

/ cos(J< < /if >) sin(Jt < hf >) \ , . 

\ -sm{Jt < /if >) cos(J/ < /if >) J ^ ' 

in the two-dimensional Hilbert spaces of each qubit i. 
The rotation parameter is exactly the same synaptic po- 
tential hi which governs the classical dynamics of the 
Hopfield model. When these rotations are applied on 
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the initial state (|SJ they amount to a single update step 
transforming the qubit spinors into 



1 / cos(Jt <hf >) + sin( Jt < /if >) 



^2 V cos( <hf >)- sin(Jt < >) 



(10) 



This is the generalization to quantum probability ampli- 
tudes of the probabilistic formulation of classical stochas- 
tic neurons. Indeed, the probabilities for the qubit to be 
in its eigenstates ±1 after a time t, obtained by squaring 
the probabihty amplitudes, are given by /(± < >), 
where /(< /i^ >) = (1 + sin(2Jt < /i^ >))/2 has exactly 
the properties of an activation function (alternative to 
the Fermi function), at least in the region Jt < ir/A. 
In this correspondence, the effective coupling constant 
Jt plays the role of the inverse temperature, as usual in 
quantum mechanics. 

We shall now focus on a network without external in- 
puts. In this case the equation for the average pattern 
overlaps has only the solution |m| = for < Jt < 1/2. 
For such small effective couplings (high effective temper- 
atures), corresponding to weak synaptic connections or 
to short evolution times, the network is unable to re- 
member the stored pattern. For 1/2 < Jt, however, the 
solution |m| = becomes unstable, and two new stable 
solutions — ±too appear. This means that the reac- 
tion of the mean orientation of the qubit spinors against 
a small deviation from the \m\ = solution is larger 
than the deviation itself. Indeed, any so small external 
perturbation {g/J)M^ present at the bifurcation time 
t = 1/2 J is sufficient for the network evolution to choose 
one of the two stable solutions, according to the sign of 
the external perturbation. The point Jt — 1/2 represents 
a quantum phase transition |j9| from an amnesia (para- 
magnetic) phase to an ordered (ferromagnetic) phase in 
which the network has recall capabilities: the average 
pattern overlap is the corresponding order parame- 
ter. In the ferromagnetic phase the original Z2 symmetry 
of the model is spontaneously broken. 

For Jt = 7r/4, the solution becomes |too| — li which 
means that the network is capable of perfect recall of 
the stored memory. For Jt > 7r/4 the solution mp de- 
creases slowly to again. Due to the periodicity of the 
time evolution, however, new stable solutions mo = ±1 
appear at Jt = {\ -\- 4n)7r/4 for every integer n. Also, 
for Jt > 37r/4, new solutions with ^ and — 
appear. These, however, correspond all to metastable 
states. Thus, t = tt/AJ is the ideal computation time for 
the network. 

The following picture of quantum associative memories 
emerges from the above construction. States of the net- 
work are generic linear superpositions of computational 
basis states. The network is prepared in the state \ipo > 
and is then let to unitarily evolve for a time t. After 
this time the state of the network is measured, giving 
the result of the computation. During the evolution each 
qubit updates its quantum state by a rotation that de- 
pends on the aggregated synaptic potential determined 
by the state of all other qubits. These synaptic poten- 



tials are subject to large quantum fluctutations which 
are symmetric around the mean value < >= 0. If the 
interaction is strong enough, any external disturbance 
will cause the fluctuations to collapse onto a collective 
rotation of all the network's qubits towards the nearest 
memory. 

We will now turn to the more interesting case of a finite 
density a = p/n of stored memories in the limit n ^ 00. 
In this case the state of the network can have a finite over- 
lap with several stored memories ^'^ simultaneously. As 
in the classical case we shall focus on the most interesting 
case of a single " condensed pattern" , in which the net- 
work uniquely recalls one memory without admixtures. 
Without loss of generality we will chose this memory to 
be the first, fj, — I, omitting then the memory superscript 
on the corresponding overlap m. Correspondingly we will 
consider external inputs so that only Af^=^ = M ^ 0. 
For simplicity of presentation, we will focus directly on 
solutions with a non- vanishing pattern overlap along the 
z-axis, omitting also the direction superscript z. 

In case of a finite density of stored patterns, one can- 
not neglect the noise effect due to the infinite number of 
memories. This changes (jS)) to 



- ^ sin 2Jt (m + -M + Ai) , 



(11) 



As in the classical case we will assume that {^f } and 
{m'^,H ^ 1} are all independent random variables with 
mean zero and we will denote by square brackets the con- 
figurational average over the distributions of these ran- 
dom variables. As a consequence of this assumption, the 
mean and variance of the noise term are given by [A;] — 



and [Af 



where 



(12) 



is the spin-glass order parameter According to the 
central limit theorem one can now replace in Hll|l 

by an average over a Gaussian noise. 



sin 2Jt(m+-M + ^/arz] . (13) 



The second order parameter r has to be evaluated 
self-consistently by a similar procedure starting from the 
equation analogous to eq. (|ll|l for /i ^ 1. In this case one 
can use <C 1 for /i 7^ 1 to expand the transcendental 
function on the right-hand side in powers of this small 
parameter, which gives 

'^^ e^ sin^ 2Jt (jn + + ^/arz 



27r 

dz 



J 



e^ cos 2Jt (m + + y/arz) (14) 
2tt \ J / *• ' 
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FIG. 1: The phase structure of quantum associative memo- 
ries with finite density of stored patterns. P, F and SG de- 
note (quantum) paramagnetic, ferromagnetic and spin-glass 
phases, respectively. F -f SG denotes a mixed phase in which 
the memory retrieval solution is only locally stable. 

where w = (1 — 2Jtx)^r. Solving the integrals gives fi- 
nally the following coupled equations for the two order 
parameters m and r: 

m = sin 2Jt (m + ^m) e~2(./t)^ar ^ 

1 1 - cos 4 Ji (m + 4M) er^Wo^r 

2 (1 - 2 Jteos 2Jt (m + §M) e-2(.^*)'«'-) 

In terms of these order parameters one can distinguish 
three phases of the network. First of all the value of m 
determines the presence (m > 0) or absence (to = 0) of 
ferromagnetic order (F). If to = the network can be in 
a paramagnetic phase (P) if also r = or a quantum spin 
glass phase (SG) if r > 0. The phase structure resulting 
from a numerical solution of the coupled equations H15|) 



for g = is shown in Fig. 1. 

For a < 0.025 the picture is not very different from the 
single memory case. For large enough computation times 
there exists a ferromagnetic phase in which the m = 
solution is unstable and the network has recall capabil- 
ities. The only difference is that the maximum value of 
the order parameter to is smaller than 1 (recall is not 
perfect due to noise) and the ideal computation time t 
at which the maximum is reached depends on a. For 
0.025 < a < 1.000 instead, ferromagnetic order coexists 
as a metastable state with a quantum spin glass state. 
This means that ending up in the memory retrieval so- 
lution depends not only on the presence of an external 
stimulus but also on its magnitude; in other words, the 
external pattern has to be close enough to the stored 
memory in order to be retrieved. For 1 < a all retrieval 
capabilities are lost and the network will be in a quan- 
tum spin glass state for all computation times (after the 
transition from the quantum paramagnet). a = 1 is thus 
the maximum memory capacity of this quantum network. 
Note that a = 1 corresponds to the maximum possible 
number of linearly independent memories. For memory 
densities smaller but close to this maximum value, how- 
ever, the ferromagnetic solution exists only for a small 
range of effective couplings centered around Ji ~ 9: for 
these high values of Jt the quality of pattern retrieval is 
poor, the value of the order parameter to being of the 
order 0.15-0.2. Much better retrieval qualities are ob- 
tained for smaller effective couplings: e.g. for Jt — 1 the 
order parameter is larger than 0.9 (corresponding to an 
error rate smaller than 5%) for memory densities up to 
0.1. In this case, however the maximum memory den- 
sity is 0.175, comparable with the classical result of the 
Hopfield model. 

In summary, we have introduced a new model of quan- 
tum information processing that is capable of content as- 
sociation by quantum self-organization. The basic idea 
is to encode information in Hebb-type qubit interactions 
and to let the corresponding quantum evolution amplify 
the desired result, given an input, a principle that lends 
itself to many generalizations. 
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